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CLAIMS 

1. A three dimensional inspection system for inspecting ball 
array devices having a plurality of balls, wherein the ball array 
device is positioned in an optical system, the inspection system 

5 comprising: 

a) an illuminator located to illuminate at least one ball on the 
ball array device; 

b) a sensor; 

c) a first optical element positioned to transmit light to the 
10 sensor; 

d) a second optical element positioned to direct light from the 
at least one ball to the sensor, where the sensor, the first 
optical element and the second optical element cooperate to 
obtain at least two differing views of the at least one ball, the 

15 sensor providing an output representing the at least two 
differing views; and 

e) a processor, coupled to receive the output, where the 
processor processes the output by using a triangulation method to 
calculate a three dimensional position of the at least one ball 

20 with reference to a pre-calculated calibration plane. 

2. The three dimensional inspection apparatus of claim 1 wherein 
the calibration plane comprises a coordinate system having X, Y 
and Z axes and wherein an X measurement value is proportional to 

25 a Z measurement value. 
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3. The three dimensional inspection apparatus of claim 1 wherein 
the calibration plane comprises a coordinate system having X, Y 
and Z axes and wherein an XY measurement value is proportional to 

5 a Z measurement value. 

4. The three dimensional inspection apparatus of claim 1 wherein 
the calibration plane comprises a coordinate system having X, Y 
and Z axes and wherein a Y measurement value is proportional to a 

10 Z measurement value. 

5. The three dimensional inspection apparatus of claim 1 wherein 
the triangulation calculations are based on determining a center 
of the ball in a first view and determining a ball top location 

15 in a second view. 

6. The three dimensional inspection apparatus of claim 1 wherein 
the pre-calculated calibration plane is defined by measuring a 
calibration pattern. 

20 

7. The three dimensional inspection apparatus of claim 1 wherein 
the second optical element comprises a mirror. 



8. The three dimensional inspection apparatus of claim 1 wherein 
25 the second optical element comprises a prism. 
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9. The three dimensional inspection apparatus of claim 1 wherein 
one of the at least two differing views is obtained at a low 
angle of view, 

5 

10. The three dimensional inspection apparatus of claim 1 wherein 
the sensor and the second optical element are positioned to 
receive light from different angles relative to the calibration 
plane . 

10 

11. The three dimensional inspection apparatus of claim 1 wherein 
the sensor comprises a charged coupled device array* 

12. The three dimensional inspection apparatus of claim 1 wherein 
15 the sensor comprises a complementary metal oxide semiconductor 

device array. 

13. The three dimensional inspection apparatus of claim 1 wherein 
the triangulation method comprises measurements derived from the 

20 at least two differing views include grayscale edge detection to 
locate ball positions. 



14. The three dimensional inspection apparatus of claim 1 wherein 
the measurements include threshold analysis. 
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15, The three dimensional inspection apparatus of claim 1 wherein 
the first optical element comprises a lens. 

5 16. The three dimensional inspection apparatus of claim 1 wherein 
the first optical element comprises a pin-hole lens. 

17. The three dimensional inspection apparatus of claim 1 wherein 
the first optical element comprises a plurality of lens elements. 

10 

18. The three dimensional inspection apparatus of claim 1 wherein 
the first optical element comprises a telecentric lens. 

19. The three dimensional inspection apparatus of claim 1 wherein 
15 the ball array devices comprise ball grid array devices. 

20. The three dimensional inspection apparatus of claim 1 wherein 
the ball array devices comprise bump on wafer devices. 

20 21. The three dimensional inspection apparatus of claim 1 wherein 
the processor comprises a personal computer. 



25 



22. 

the 



The three dimensional inspection apparatus of claim 1 wherein 
sensor includes a solid state sensor array. 
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23. The three dimensional inspection apparatus of claim 1 wherein 
one of the views comprises a segment having a crescent shape. 



24. A three dimensional inspection apparatus for ball array 

5 devices having a plurality of balls, the apparatus comprising: 

a) an illuminator positioned to produce reflections from the ball 
array device; 

b) a sensor disposed to receive light at a first angle relative 
to the ball array device; 

10 c) a first optical element positioned to transmit light to the 
sensor, where the sensor obtains a first view of the ball array 
device; 

d) a second optical element disposed to receive light at a second 
angle different from the first angle and to transmit a second 

15 view of the ball array device to the sensor; 

e) a frame grabber coupled to the sensor to transmit image 
information from the sensor; and 

f ) a processor, coupled to receive the image information, where 
the processor applies triangulation calculations to measurements 

20 of the image information so as to calculate a three dimensional 
position of at least one ball with reference to a pre-calculated 
calibration plane. 

25. The three dimensional inspection apparatus of claim 24 
25 wherein the calibration plane comprises a coordinate system 
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having X, Y and Z axes and wherein an X measurement value is 
proportional to a Z measurement value. 

26. The three dimensional inspection apparatus of claim 24 

5 wherein the calibration plane comprises a coordinate system 
having X, Y and Z axes and wherein an XY measurement value is 
proportional to a Z measurement value, 

27. The three dimensional inspection apparatus of claim 24 
10 wherein the calibration plane comprises a coordinate system 

having X, Y and Z axes and wherein a Y measurement value is 
proportional to a Z measurement value. 

28. The three dimensional inspection apparatus of claim 24 
15 wherein the pre-calculated calibration plane is defined by 

measuring a calibration pattern. 

29. The three dimensional inspection apparatus of claim 24 
wherein the second optical element comprises a mirror. 

20 

30. The three dimensional inspection apparatus of claim 24 
wherein the second optical element comprises a prism. 

31. The three dimensional inspection apparatus of claim 24 
25 wherein the illuminator comprises a ring light. 
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32. The three dimensional inspection apparatus of claim 24 
wherein the illuminator comprises a plurality of light emitting 
diodes . 

5 

33. The three dimensional inspection apparatus of claim 24 
wherein the illuminator comprises reflected light. 

34. The three dimensional inspection apparatus of claim 24 
10 wherein the sensor comprises a charged coupled device array. 



35. The three dimensional inspection apparatus of claim 24 
wherein the sensor comprises a complementary metal oxide 
semiconductor device array. 

36. The three dimensional inspection apparatus of claim 24 
wherein the ball array devices comprise ball grid array devices 



37. The three dimensional inspection apparatus of claim 24 
20 wherein the ball array devices comprise bump on wafer devices. 



38. The three dimensional inspection apparatus of claim 24 
wherein the measurements from the first image and the second 
image include grayscale edge detection to locate ball positions 



25 
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39. The three dimensional inspection apparatus of claim 24 
wherein the measurements include threshold analysis, 

40. The three dimensional inspection apparatus of claim 24 
5 wherein the first optical element comprises a lens. 

41. The three dimensional inspection apparatus of claim 24 
wherein the first optical element comprises a pin-hole lens. 

10 42. The three dimensional inspection apparatus of claim 24 

wherein the first optical element comprises a plurality of lens 
elements . 

43. The three dimensional inspection apparatus of claim 24 

15 wherein the first optical element comprises a telecentric lens. 

44. The three dimensional inspection apparatus of claim 24 
wherein the illuminator comprises a ring light. 

20 45. The three dimensional inspection apparatus of claim 24 

wherein the sensor includes a solid state sensor array. 



25 



46. The three dimensional inspection apparatus of claim 24 
wherein the processor comprises a personal computer. 
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47. The three dimensional inspection apparatus of claim 24 
wherein the second optical element reflects a view to the sensor 
where at least one ball of the ball array device exhibits a 
crescent shape. 

5 

48. A three dimensional inspection apparatus for ball array 
devices having a plurality of balls, the apparatus comprising: 

a) an illuminator disposed to illuminate a ball array device; 

b) a sensor disposed to receive light at a first angle relative 

10 to the ball array device, and wherein the sensor includes a solid 
state sensor array; 

c) a first optical element positioned to transmit light to the 
sensor, where the sensor obtains a first view of the ball array 
device; 

15 d) a second optical element disposed to receive light at a second 
angle different from the first angle and to transfer a second 
view of the ball array device to the sensor; 

e) an image acquisition apparatus coupled to the sensor to 
transmit image information representing the first view and the 

20 second view; and 

f) a processor, coupled to receive the image information, where 
the processor applies triangulation calculations to measurements 
of the image information so as to calculate a three dimensional 
position of at least one ball with reference to a pre-calculated 

25 calibration plane, wherein the calibration plane comprises a 
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coordinate system having X, Y and Z axes, and wherein an X 
measurement value is proportional to a Z measurement value, 

49. The three dimensional inspection apparatus of claim 48 
5 wherein an XY measurement value is proportional to a Z 

measurement value. 

50. The three dimensional inspection apparatus of claim 48 
wherein a Y measurement value is proportional to a Z measurement 

10 value. 

51. The three dimensional inspection apparatus of claim 48 
wherein the pre-calculated calibration plane is defined by 
measuring a calibration pattern. 

15 

52. The three dimensional inspection apparatus of claim 48 
wherein the measurements include grayscale edge detection to 
locate ball positions. 

20 53. The three dimensional inspection apparatus of claim 48 
wherein the measurements include threshold analysis. 

54. The three dimensional inspection apparatus of claim 48 
wherein the illuminator comprises a plurality of light emitting 
25 diodes. 
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55, The three dimensional inspection apparatus of claim 48 
wherein the illuminator comprises reflected light. 

5 56. The three dimensional inspection apparatus of claim 48 

wherein the ball array devices comprise ball grid array devices. 

57. The three dimensional inspection apparatus of claim 48 
wherein the ball array devices comprise bump on wafer devices. 

10 

58. The three dimensional inspection apparatus of claim 48 
wherein the solid state sensor array includes a charged coupled 
device array. 

15 59. The three dimensional inspection apparatus of claim 48 
wherein the solid state sensor array includes a complementary 
metal oxide semiconductor array. 

60. The three dimensional inspection apparatus of claim 48 
20 wherein the second optical element comprises a mirror. 

61. The three dimensional inspection apparatus of claim 48 
wherein the second optical element comprises a prism. 



25 62. The three dimensional inspection apparatus of claim 48 
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wherein the second view comprises a segment having a crescent 
shape. 

63. The three dimensional inspection apparatus of claim 48 
5 wherein the image acquisition apparatus comprises a frame 

grabber . 

64. The three dimensional inspection apparatus of claim 48 
wherein the processor comprises a personal computer. 

10 

65. The three dimensional inspection apparatus of claim 48 
wherein the first optical element comprises a lens. 

66. The three dimensional inspection apparatus of claim 48 

15 wherein the first optical element comprises a pin-hole lens. 

67. The three dimensional inspection apparatus of claim 48 
wherein the first optical element comprises a plurality of lens 
elements . 



20 



68. The three dimensional inspection apparatus of claim 48 
wherein the first optical element comprises a telecentric lens, 



69. The three dimensional inspection apparatus of claim 1 further 
25 comprising a diffuser disposed to provide illumination for 
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imaging of a perimeter of the ball array device. 

70. The three dimensional inspection apparatus of claim 24 
further comprising a diffuser disposed to provide illumination 

5 for imaging of a perimeter of the ball array device . 

71. The three dimensional inspection apparatus of claim 48 
further comprising a diffuser disposed to provide illumination 
for imaging of a perimeter of the ball array device. 

10 

72. A three dimensional inspection apparatus for ball array 
devices having a plurality of balls, wherein the ball array 
device is positioned in a fixed optical system, the apparatus 
comprising: 

15 a) an illumination apparatus positioned for illuminating the ball 
array device; 

b) a camera disposed in a fixed focus position relative to the 
ball array device for taking a first image of the ball array 
device to obtain a circular doughnut shape image from at least 

20 one ball; 

c) an optical element disposed in a fixed focus position relative 
to the ball array device for transmitting a second image of the 
ball array device to the camera to obtain a side view image of 
the at least one ball; and 

25 d) a processor, coupled to receive the first image and the second 
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image, that applies triangulation calculations on related 
measurements of the first image and the second image to calculate 
a three dimensional position of the at least one ball with 
reference to a pre-calculated calibration plane, 

5 

73. The three dimensional inspection apparatus of claim 72 
wherein the second image comprises a segment having a crescent 
shape- 

10 74. The three dimensional inspection apparatus of claim 72 
? fc wherein the calibration plane comprises a coordinate system 
^ having X, Y and Z axes and wherein an X measurement value is 
IV proportional to a Z measurement value, 

Ij 15 75. The three dimensional inspection apparatus of claim 72 

3 wherein the triangulation calculations are based on determining a 

center of the ball in the first image and determining a ball top 

location in the second image, 

20 76. The three dimensional inspection apparatus of claim 72 
wherein the pre-calculated calibration plane is defined by 
measuring a calibration pattern. 

77. The three dimensional inspection apparatus of claim 72 
25 wherein the optical element comprises a mirror that reflects 
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light between the ball array device and the camera. 

78. The three dimensional inspection apparatus of claim 72 
wherein the second image is obtained at a low angle of view. 

5 

79. The three dimensional inspection apparatus of claim 72 
wherein the camera and the optical element are fixed at different 
angles relative to the calibration plane. 

10 80. The three dimensional inspection apparatus of claim 72 
wherein the camera comprises a charged coupled device array. 

81. The three dimensional inspection apparatus of claim 72 
wherein the measurements from the first image and the second 

15 image include grayscale edge detection to locate ball positions. 

82. The three dimensional inspection apparatus of claim 72 
wherein the illumination apparatus further comprises a diffuser. 

20 83. The three dimensional inspection apparatus of claim 72 

wherein the ball array devices comprise ball grid array devices. 

84. The three dimensional inspection apparatus of claim 72 
wherein the ball array devices comprise bump on wafer devices. 



25 
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85. The three dimensional inspection apparatus of claim 72 
wherein the camera comprises a complementary metal oxide 
semiconductor device array. 

5 86. The three dimensional inspection apparatus of claim 72 
wherein the triangulation calculations include threshold 
analysis . 



